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What I'll soeak about 


Part | - Introduction to QRA codes and decoders 
Part Il - A QRA code for EME. Simulation results 
Part Ill - Exploiting the redundancy of a QSO 


Part IV - The new QRA64 mode for WSJT-X 


|. Introduction to QRA codes and 
decoders 


Historical Perspective 


~1960 - Low Density Parity Check (LDPC) codes 
introduced by Robert Gallager at M.I.T. 


1963...'80s — Nothing happens. Decoding too complicate 
for those years technology. 


1993 — Alain Glavieux/Claude Berrou introduce Turbo 
codes and iterative decoding. 


1995 — David MacKay resurrects Gallager's LDPC codes 
and shows how to decode them with Message Passing. 


2000 —Aamod Khandekar/Robert McEliece at Caltech 
introduce Irregular Repeat-Accumulate (IRA) codes. 


...2016 — LDPC codes used everywhere from deep-space 
probes to mobile phones... and in WSJT-X as well! 
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LDPC Codes 


¢ Low Density Parity Check means that the parity check 
matrix of the code is (very) sparse: 


- Each parity check equation involves few codeword symbols 
- Each codeword symbol is involved in few parity check equations 
e Parity check matrix H: 
- Rows indicate parity check equations 
- Columns indicate codeword symbols 
- Codewords x satisfy the set of equations H*x=0 
Example: Hamming (7,4) code. Not a LDPC code: H is not sparse 


1010 1 0 1\<)) X1+x3+x5+x7=0 
H=|0 1 1 0 0 1 = =J1|<«—— x2+x3+x6+x7=0 
00 01 1 1 Ifo x4 +x5+x6+x7=0 
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QRA Codes 


¢ Class of LDPC codes with Q-ary symbols set 
- Q=4, 8, 16, 32, 64,... or any number for which a finite field exists 
- Maps naturally to orthogonal modulations (i.e. 64-FSK) 

¢ Repeat-Accumulate (RA) encoding: 


- Information symbols are repeated (like in a repetition code), 


- Parity checks are generated as a weighted accumulation of the 
repeated information symbols sequence 


¢ Same decoding procedure of LDPC codes 


- Maximum A-Posteriori Probability with the Message Passing (MP) 
algorithm 
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MAP Decoding 


¢ Maximum A Posteriori (MAP) Probability 
e Bayes' rule: 
Prob(X|R) proportional to Prob(R|X) * Prob(X), where: 


X = transmitted codeword, 

R = received signal sequence 

Prob(X|R) = a posteriori probability <-- What we need to compute 

Prob(R|X) = likelihood <-- Channel dependence 

Prob(X) = a priori probability <-- Code and a priori knowledge dependence 

e For each codeword symbol we need to maximize the symbol- 

wise probability Prob(X|R) averaging Prob(X/R) over all the 
possible cases we are interested into: 


- Prob(X]|R) = sum of Prob(X|R) over all codewords with given X 
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General Case MAP Decoding 


¢ Given the likelihoods and any a priori knowledge: 
1. Compute ALL the codewords a posteriori probabilities 
2. For each information symbol: 


a) Sum the probabilities of ALL the codewords in which a symbol 
assumes a given value, and 


b) Select as the best estimate of a symbol the value which 
maximizes its a posteriori probability distribution 


¢ Complexity scales exponentially with codeword length 
¢ Example: K=72 information bits => ~272 operations => 


Hundreds thousands years to decode a single message 
(using a good PC) 
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Tanner Graphs 


e Alternative representation of a code parity check matrix 


- Mark codeword symbols with circles 
- Mark parity check equations with boxes 


- Connect circles to boxes with edges to indicate which symbol is 
involved in a given check equation 


¢ Immediate sight of code properties (i.e. cycles) 


Check 1 Check 2 Check 3 


0 Example: Hamming (7,4) code 


X1+x3+x5+x7=0 (Check 1) 


x2 +x3+x6+x7=0 (Check 2) 


x4 + x5 +x6+x7=0 (Check 3) 


x1 x2 x3 x4 x5 x6 x7 
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MAP Decoding of LDPC codes 


A posteriori probabilities can be computed exactly if the 
code Tanner graph is a tree (has no cycles) 


Parity check equations with few variables and variables 
involved in few checks => very fast evaluation of 
probabilities factors 


LDPC codes can be designed to have few and sufficiently 
large length (girth) cycles (no good code graph is a tree), 


LDPC codes involve few variables per parity check 
equation and few equations per variable => 


A posteriori probabilities can be evaluated with good 
precision and much more quickly than in the general case 


Decoding complexity scales linearly with codeword length 
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Tanner Graph of a QRA Code 


Parity check 
¢ x's denote information symbols equations involves 
max. 3 codeword 
e y's denote parity check symbols symbols 


Permutation . / 
matrix designed to 5 
exclude short 
length cycles 


/) max. r, checks 
eq. per symbol 
(avg. r,~4) 


a) ee ee a CE, 
Xx Xx Xx Xx 
1 2 3 4 
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Message Passing Decoder 


MAP probabilities evaluated iteratively exchanging 
“messages among circles (codeword variables) and 
boxes (check equations) 


The messages are actually probability distributions 


Each iteration is a two step process: 


- ¢—v step : send messages from checks to variables 
- v—c step : send messages from variables to checks 


After each iteration find the symbol values which maximize 
the (approximate) a posteriori probability and check if all 
parity check equations are satisfied (Successful decode) 


Stop if no success within a max. number of iterations 
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Il. Simulation Results 
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QRA(12,63) © RS(12,63) 


¢ AWGN channel, QRA MP decoder with 100 iterations 
¢ Same code parameters/modulation/sync. pattern of JT65: 


- K=12, N=63, 64-FSK (non coherent demod.), 63 sync. symbols 


.Reed-Solom 
5 Ls eneoging 
oe ee 
g 
= 
64-NCFSK 
AWGN Channel 
Capacity 
(R,=12/63) 
-27 -26 -25 -24 -23 -22 -21 
SNR in 2500 Hz Bandwidth (dB) 
2 3 4 5 6 7 8 
Eb/No (dB) 
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QRA(12,63) © RS(12,63) 


e Rayleigh channel, QRA MP decoder with 100 iterations 


e Same code parameters/modulation/sync. pattern of JT65 


100 poe ee 
JT65 ae 


Deep-Search +” 
80 eee 


60 


Berlekamp / 


Massey ; 


Percent copy 


/ 
/ 
' 
/ 
/ 
40 ' % ; 
: : : 
’ 
7 << : 
‘ 
F ’ 
' 
' 
' 


x 


20 


0 —o popece 
30 -29 -28 -27 4-26 -25 -24 «2-23 «2-22 «2-21 «2=-20 © «-19 = -18 
SNR in 2500 Hz Bandwidth (dB) 


IV3NWV - Q-ary Repeat-Accumulate Codes for Weak Signals Communications 15 


XVII EME Conference - Venice, 2016 


Ill. Exploiting the redundancy of a 
QSO 
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Decoding with “a priori: Knowledge 


1) No a priori avail. => Maximum Likelihood (ML) decoder 
2) Apriori available => Maximum A Posteriori (MAP) prob. decoder 


MAP decoders easily handle both cases 
ML is just a special case of MAP 
MAP is much better than ML 


e Atwo-way QSO is a sequence of messages with decreasing amount 
of uncertainty/increasing amount of a priori (AP) knowledge: 


¢ First message in a QSO is a CQ call, i.e. [ CQ IV3NWV JN66 ] 
¢ First replies (if any) directed to our call, i.e. [ IV3NWV SM5BSZ JO89] 
e Further replies come from known source, i.e. [ IV3NWV SM5BSZ -25 | 
e Last reply is just an acknowledge, i.e. [ !\V3NWV SM5BSZ 73 | 

=> INSTRUCT THE DECODER TO HANDLE ALL THESE CASES! 
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Typical QSO “a priori’ 


Sample QSO between IV3NWV and SM5BSZ: 


1. CQ IV3NWV JN66 
2. IV3NWV SM5BSZ JO89 
What SMSBSZ's_/ : 
der k -_, 3. SM5BSZ IV3NWV -25 \ 
de ste af : — \ \ What IV3NWV's 
; \ 4. IV3NWV SM5BSZ R-25 a decoder knows 
semantics . / ¢ QsoO 
+5. SM5BSZ IV3NWV 73 ss 
j semantics 
6. IVZ3NWV_ SM5BSZ 73” 


¢ Underlined fields fed to the MAP decoder as “a priori” info as the 
QSO proceeds to the end 


e 1 field — ~28 bitAP - 2 fields — ~56 bitAP - 3 fields — 72 bit AP 


A 
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QRA Decoder with AP ~— JT65 
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¢ QRA(12,63) code with same parameters/modulation/sync. pattern of JT65 
e Rayleigh channel — sync. losses not included 
¢ Decode always with info received from the channel (unlike the JT65 deep-search) 
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QRA Decoder UER Performance 


Code: QRA13-64-64-irr-e - Rayleigh Channel 


Error Rate 


-31 -30 -29 -28 -27 -26 -25 -24 -23 
SNR in 2500 Hz Bandwidth (dB) 


Undetected Error Rate (UER) improved through design of a QRA(13,64) code. 
13" symbol is a CRC-6 check computed from the 12 information symbols 

The CRC-6 symbol is not sent through the channel (punctured code) 

The resulting code is still a QRA(12,63) with much better UER (< 104-4) 
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IV. The QRA6G4 mode 
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QRA64 


New mode(s) for WSJT-X 


Based on a irregular QRA(12,63) code with the same rate/symbol set 
of the RS code used in JT65: 


- 12 information symbols (each 6 bit long) 
- 51 parity check symbols (codeword length = 63 symbols) 
- Actually a punctured QRA(13,64) code over GF(64) with CRC-6 


21 symbols synchronization pattern made by three 7x/ Costas arrays 
(Tnx Joe Taylor —K1JT)— 1.9 dB sync. energy gain over JT65 


Submodes A, B, C, D, E to handle Doppler spreads up to microwaves 
QRA encoder/decoder (me - IV3NWV) 

sync algorithms/WSJT-X integration/twistles and bells (Joe — K1JT) 

> 3 dB coding gain over JT65 (with no AP knowledge) 

< -28 dB SNR threshold at 50% copy exploiting AP on CQ calls 
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QRA64 - 10 GHz EME On-Air Tests 


Made by Charlie Suckling G3WDG and Rex Moncur VK7MO 
during July/August 2016 


Tests made with the 1.7.0 WSJT-X development version 
Lot of wav files recorded from real EME QSOs 
Tested Doppler spreads from ~O Hz and up to 100 Hz 


QRAG4A, B, C, D, E modes and JT4F mode recordings to evaluate 
differences, benefits or disadvantages 


Performance compared using SNR degradation feature of WSJT-X: 


1) Degrade wav files SNR until messages are no more decoded 
2) The higher the SNR degradation, the better the performance 
Very useful to understand how to handle fast-fading conditions: 


QRA64 gains ~6 dB over JT4 when proper fast-fading likelinoods 


metric is used 
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QRA64D EME Tests (G3WDG — VK7MO) 
10 GHz - 100 Hz Doppler Spread — No Fast-Fading Metric 


Rx Signal Spectrogram - fname = 160805-0823.wav-Oversampling=8 Submode=D Degr=0.0 dB 


Correlation peak 
of the Costas 
arrays not really 
evident 
(many sec. peaks) 
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QRA64D with Fast-Fading Metric 


Same file as before — 10 GHz/100 Hz Doppler Spread — Fast-Fading Likelihoods Processing 


Rx Signal Spectrogram - fname = 160805-0823 wav-Oversampling=8 Submode=D Degr=0.0 dB 


More evident 
sync correlation 
peak 
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QRA64 with Fast-Fading Metric 


10 GHz/100 Hz Doppler Spread - SNR of original file degraded by 9 dB 


- fname = 160805-0823 wav-OQversampling=8 Submode=D Degr=9.0 dB 


Rx Signal Spectrogram 


Sync correlation 
peak still evident 


t (s) 


Costas Array Pattern Correlation - Max at F=993.27H2z / t=5.69s 


Signal is hardly 


visible on a _ 
waterfall : 
Estimated SNR 
a a we ae ee ee a | ~ -28 dB. 
praniniennant Successful 
decoding. 


~6 dB gain over 
JT4F 


Fast-Fading Metric recovers almost all the losses a single matched filter decoder exhibits 
IV3NWV - Q-ary Repeat-Accumulate Codes for Weak Signals Communications 26 
XVII EME Conference - Venice, 2016 


QRA Codes Software Availability 


¢ General purpose QRA encoding/decoding software with 
AP features stable and available as Open Source (GPL 
License) for Windows and Linux platforms here: 


- http://github.com/microtelecom/qracodes 
(not yet fully documented but evaluation tools included) 


e Integration into WSJT-X to be completed with fast-fading 
metric/freq. drift compensation 


- Use JTSDK and WSJT-X software repository for WSJT-X specific 
developments. 
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..and thank you all for your attention 


13 
Nico Palermo, IV3NWV 
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